DOCUMENT RESUME 



ED 095 868 



IB 001 048 



AUTHOR 
TITLE 

INSTITUTION 

SPONS AGENCY 
PUB DATE 
NOTE 

EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



Zunde, Pranas 

Scientific and Technical Intonation Transfer for 
Education (STITE) • Research Report No. 2. 
Georgia Inst, of Tech., Atlanta. School of 
Information and Computer Science. 
National Science Foundation, Washington, D.C. 
Dec 73 

73p. ; For related documents see IR 001 047 and 049 
HF-S0.75 HC-S3.15 PLUS POSTAGE 

Algorithms; Computer Assisted Instruction; Indexing; 
Information Centers; Information Dissemination; 
♦Information Needs; Information Processing; 
Information Retrieval; Information Storage; 
♦Information Systems; Information Utilization; 
Literature Reviews; Mathematical Logic; ^Science 
Education; ^Sciences; ^Technology 
Scientific Technical Information Transfer for ED; 
♦STITF 



ABSTRACT 

STITE (Scientific and Technical Information Transfer 
for Education) is basically a system to interface between science 
information and the science learner. As such STITE acts as a link 
between STIC (Science and Technology Infrosation Centers) and IIS 
(Learning Information Systems) . In this second progress report the 
internal knowledge of STITE is the sain focus. Discussed are the 
algorithms, tree structures, descriptors, concepts, and 
representations considered part of STITE. Included in this report is 
a literature survey on different parts of LIS. (See also IR 001 047 
and IR 001 049.) (WH) 
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PART ONE 

MAJOR FUNCTIONS OF THE ST1TE SYSTEM 
Pranas Zundc and N. V. Subramanian 

I. INTRO DUCT 10:i 

One of the major areas of concentration of research effort was the 
identification and SDeci fi cation of the types of potential outputs of the 
STITE system which would be helpful to educators in preparing, developing, 
and maintaining teaching materials and devices of all sorts. Seventeen 
classes of such hypothetical outputs were identified; in the sequel, a class 
of outputs of the STITE system, associated with some particular function, is 
referred to as task . For each of these (as yet hypothetical) tasks, inputs 
are required for implementing the particular task, type of system's output, 
options available to educators In modifying tasks and data base requirements 
fnr a particular task. A tentative studv of overall file organization was 
also made. All these specifications were prepared primarily with graph theory 
as the experimental subject area In mind. 

II. LIST OF TASKS 

1. Task No. 1. - Preparation of Course Outline 

Input - A sequence of major topics that are Intended to 

be covered by an educator In a specific course. 
Query for the course outline. 

Output - A detailed course outline, giving all the available 

sub-topics under each topic mentioned in the input. 

Option - The educator can either choose all the sub-topics 

or delete some. of them. Under a specified major 
topic, the educator keeps In mind the specific 
course that he wishes to offer to the student and 
the objectives of that course. 



9 

ERIC 



Data Base - A table which contains all the sub-topics under 
Requirements each ma j or top , c and possib i y in a scqucncc as 

per the relationship between the individual mnjor 
topics. 

2. Task tlo. 2. - Preparation of narrative Presentations. 

Input - Sub- topics and qucrv for the narrative presenta- 

r tlons. 
Output - Set of all relevant theorems. 

- Proofs of above theorems, giving all the axioms 
and the theorems used in the proof of the theorem 
under consideration. 

- Presentation of yraphical data in support of the 
above theorems. 

- Explication of concepts associated with each sub- 
topic chosen by the educators. 

Option - Educators have the option of selecting some of 

the theorems and concepts, depending on the level 
of difficulty of the course they are planning. 

Data Base - All theorems under each sub-topic with proofs. 

Requirements Graphical data explicating the theorems (If any) 

- A glossary of all concepts and supporting figures 
or formulas, if any. 

3. Task No. 3 . - Presentation of illustrative examples (graphic 

data, or a table or a numerical example) for 
theorems. Illustrative examples for concepts . 
Here the examples need to be listed under each 
sub-topic, each theorem, and each concept . 
Input - Sub- topic, theorem number, or the key word for 

the theorem and the code number of the concept. 
Query for the illustrative examples. 
Output - Illustrative examples on a printer, graphical 

data on a display unit, numerical examples on a 
CRT. 
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Option - The educator, on previewing the problems on CRT 

or any other display unit, can choose some of the 
examples to be printed out in a printer. A CALCOM 
plotter can be coupled if a graph has to be plotted 
in the example under consideration. 
Data Dase - All the illustrative examples, including numerical 
Requirements examples, graphical data, tables etc., with the 

appropriate key word descriptions of the theorems. 
Concepts and sub-topics. 

k. Task Mo. k. - Presentation of Problems Unc'cr Erch Sub-tor>ic or 

Under Each Theorem Sub-topic or I'nder Each Concept 
In a Sub-tonic . 

Input - Sub- topic, theorem number or key word for the theorem 

and the code number of the concept. Query for the 
problems which are direct application of the concepts, 
Query for the solutions of the chosen problems, on 
Identifying the problem number. 

Output - The problem on a printer or on a CRT, along with the 

number which is a measure of the level of difficulty 
of the problems determined and entered into the systei 
by the subject, expert who works with system develop- 
ment staff. 

Option - The educator community can choose the problems 

according -O the level of difficulty desired by the 
educator community or according to the IQ index 
of the students in the case of individualized pro- 
grammed instruction. • 
Data Base - A set of problems with level of difficulty markers 
Rcc|ui rcrcnts referenced with appropriate kev word descriptors and 

cross linked with the descriptors of the theorems, 
concepts and sub-topics. 

5. Task Mo. 5. - Presentation of Dibl fooranhy Under Each Tc^ic or 

Sub-Topic 
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input - Document specifications in a descriptor language 

having the descriptors of sub-topic or concept 
words in the chosen topic. 0.uerv for references. 

Output - A set of references under the heading of each sub- 

topic or major topic, depending on the design of 
programs. 

Option - The educator can retrieve the set of references on 

a CRT and scan it before he gets a hard copv of the 
same, or in case of microfiche storaae or references, 
the educator can retrieve the appropriate microfiche 
card and, after readinq the relevant references on 
a microfiche reader, receive a hard copy of the same. 
Data Rase - Depending on the storage mechanism (whether on tape 
Requirements oj> Qn m i croficne ) tne set of references with the 

document specifications should be stored with the 
links to aoproeriate abstracts. 

6. Task No. 6. - Presentation of Application of Theoretical Concepts 

In Each Major Topic. 
Input - The concept codes and the theorem numbers. Query 

for anplication of the theoretical concepts In each 
major topic. 

Output - The educator gets a visual display of the titles of 

all applications on store under a given topic. Some 
of the applications are chosen and are subsequently 
printed on a line printer. 
Data Base - A disk has all the apol ications of ,e theoretical 
Requi rements concept codes or theorem numbers or the descriptors 

of a major topic. 

These real world application, In turn, may have 
numerical examples or graphical data as illustrations 
of specific applications In certain science fields. 
Therefore this task is linked with task No. 3, and 
may share the same files being utilized for task Ho. 3« 
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7. Task No. 7. " 



Input 



Output 



Data Base 



Presentation of Case Studies (i.e. citation of real 
world cases and analysis of the same from the point 
of view of some of the theoretical concepts explicated 
in the earlier tasks. For example, In the field of 
graph theory they might include engineering applica- 
tions, human sciences applications, application in 
physical sciences, operations research, etc.) 
Here the titles of some of the real world cases are 
presented, Query for an analysis of the presented 
field from the point of view of the theoretical 
concepts in a subject. 

Depending on the relational entailment structure of 
the concepts and the applications, the relationships 
between the chosen case and the concepts in the 
chosen subject area are pointed out on a printer. 
• A relational structure of the basic concepts in 
Requirements the choscn su bject area and the applications in the 

real world should be created on the data base. A 
parser program micht eventually be developed which 
creates the syntactic structure of the basic concepts 
and their links with the applications in the real 
v.3rld. 

8. Task No. 8. - - — " f ° f ^ C?f!C DOCU ';' ntS 

"~ — The keywords for the desired reference or the 

reference numbers, presented in task No. 5, os 
output. Query for the abstract of the sane. 
The abstract of the references in the query are 
printed on a line printer. 
Data Base - Ma 9 netlc tapes w. th the abstracts of a. I the ro- 
RequircMon ts ference nunbcrs . It Is olso proposed to mcludo 

In the entailment structure the relationships 
between .abstracts in a co^on relation with , con- 
cept or a theoren. or a sub-topic. It would he 
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desiroblc to have built into' the data base the^ 
capability of retrieving all related abstracts upon 
the presentation of the reference number of one 
specific abstract. 

9* Task Mo. 9. - Presentation of the State-gf-thcArt cr of :^»; tracts. 

Covering a Specified Period . 
>n P ut " Give specifications of tirr.e period such as 6 months, 

1 year, or 2 years. Query for the abstracts of alt 
the documents published in the specified period of 
time. 

Output " The abstracts of all the documents published in the 

specified period of time are printed on a line printer 

Data 3a?e - This task requires that all the abstracts with their 
Requirements 

— publication date be stored. In addition the system 

should have the processing features necessary to do 
the desired task. In short, all the above tasks 
require a considerable amount of programming for 
these specific task. 

10. Task Ho. 10 - Presentati o n of Historical Development of a 

Specific Discipl ine (i.e. retrieval by date of 
publication so that latest is retrieved last.) 
In£2| - Query for the historical development of a specific 

subject discipline, with a specification of time 
such as past ten years. 
Output - Retrieval of abstracts of all the relevant docu- 

ments in order of date of publication, with latest 
first and oldest last. 

Data Base - This task does not impose additional file structures, 
Requi reran ts . . . . . 

— 3 — but it does rcauire additional application programs 

or stored programs which search the data base on 
the basis of date of publication. This has to be 
accomplished in several passes. 
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During th* first pass, the processor keeps a record 
of the latest publication so far searched and, on 
searching the entire file, puts a marker 1 1 1 on the 
latest publication. Then it executes the same program 
again, searching only the no-marked abstracts. The 
machine carries on this till It finds all the abstracts 
published in the specif ieJ period of time. 

11. Task No . 11 . - Preparation of Quizzes of Tests for Students . 

- An interactive program is to be developed to 
accomplish this task. On keying In the level of 
difficulty markers, the educator gets a display of 
all problems and questions with the specified level 
of difficulty markers. Then he chooses some of the 
problems and questions according to the length and 
type of test he desires to give to his students. 
Upon Identifying the selected problems with appro- 
priate descriptors, the educator gets a print-out 
of his model test paper. 

Another less flexible alternative might be the 
programming of actual tests. Here pre-structured 
test papers can be put on the data-baje by a 
team of subject experts. This should be accessible 
by authorized personnel and educators only. Test 
papers can then be retrieved by the educators for 
the purpose of giving a quiz or an exam to students. 

12. Task No. 12 . - Presentation of a Set of Relevant Questions On 

Topics or Sub-Topics . 

- The keyvords for the topic or sub-topic. Query 
for descriptive type questions and problem type. 

- This task shares a common file with task No. 11. 
A list of questions under the heading of the 
specified topic or sub-topic. 

- The educator can choose the questions to be printed 
out on the printer. 
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Data B ase - No additional file requirements for this specific 
Requhv.^nts, task< a special application program is required to 

be developed for this task. 

Task No. 13 - Identification of »cw Concepts and Preparation of 

Updated Materials for a Specific Tonic . 

Input - Query for updated materials for the narrative pre- 

sentations. 

Output - New concepts, new theorems to be included in certain 

sub-topics. The new concepts appear under the 
appropriate sub-topics on the print-out. 
Data Base - A program package which parses the abstracts, com- 
Requircr >nts pares w j th concept descriptors in store, 

Identifies the new concepts and forms the basis 
of the link of the abstracts with the sub-topics, 
determines the update materials under a specific 
sub- topic. 

Task No. Ijj - Retrieval of All Abstracts Relate d to a Specific 

Abstract . 

Input - The reference number of the abstract. Query 

for all the relevant abstracts. 

Output - All the relevant abstracts (based on the links 

between abstracts to be established in the entail- 
ment structure) are printed on a line printer. 

Data Base - No additional file requirements, but it is necessary 

Reguircr-ents tQ devclop additional features in the appropriate 

application programs. This task mainly depends on 
the entailment structure of the abstracts in a given 
subject discipline. 

Task Ho. 15 - Presentation of Definit ions of Concents, (i.e., 

given an explanation or definition of a concept 
present the explanations or definitions of all 
the concepts required for the explanation of the 
specific concept under consideration.) 
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Input - Concept code number In the glossary file. Query 

for all the relevant concepts. 
Output - All the relevant concepts or definitions based on 

the links between the concepts (to be established 

In the entailment structure), are printed out on a 

1 Ine printer. 

Data Base - No additioral file requirements. Requires the 
Requi reman ts , . . . ... . , , 

— development of additional features in the necessary 

application programs. This task mainly depends on 
the entailment structure of the concepts In the 
glossary file of a given subject discipline. 

16. Task [So. 16 - Presentation of Subjects, With References and 

Abstracts for Assignments for Students . 
Input - Major topic descriptors. Query for assignments 

or term papers for students. 
Output - Titles for term papers with a set of references 

as a guide to the students. 

Data Base - A separate magnetic tape file with all possible 
Requi rcn ents . ... 

• — term paper titles, along with the appropriate sets 

of references. 

17. Task Ho. 17 - Presentation of a Measure of Newness of a Particular 

Concept . (Given a statement or concept as input, 
provide a measure of newness of the concept on pro- 
cessing the descriptors or the keywor.ds In the new 
concept, comparing It with the descriptors of the 
concepts in store.) 
Input - A statement or a definition of a new concept from 

an abstract. Query for the newness measure of the 
! concept. 

Output - A statement giving a measure of the newness of the 

concept. 

Data Gosc - An appl Ication. program which compares the descriptors 

Requi rcr :ents 
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of the new concept with the descriptors ot tho 
basic concepts on store and with the d;-;cr Luors 
of the concepts added so far frcn the «i-\tr.-»c:s. 
A relative Measure of the ratching cf tv.o con be 
calculated by the machine according to preset 
standards, and the result ap, cars on t»." CUT. 



ML DESCPxlPTI OM OF TVZ FILE ORGANIZATION 

Following is a rudimentary outline of the file organ irnt icn of the STITE 
system required for performing the above described tasks* 

1. Task No. 1. - access to file numbers 2 and 3 

no processing required* 

2. Task No. 2 - accesses to file 7» 8 and 9 

no processing required* 

3. Task No. 3 ~ accesses to file 10 

no processing required. 
A. Task No. k. - accesses to file 6 

no processing required. 

5. Task No. 5« • accesses to file 11 

no processing required. 

6. Task No. 6. - accesses to file 1 

no processing required. 

7. Task No. J. - accesses to file 5 

no processing required. 

8. Task No. 8. - accesses to file 12 

no processing required. 

9. Task No. 9. - accesses to file 12 

processing required. 
: 10« Task No. 10. - accesses to file 12 

processing requi r^d. 

11. Task No. 11. - accesses to file 13 

no processing required. 

12. Task No. 12. - accesses file 13 

no processing required* 



13. Task Ho* 13. 

\k. Task J!o. 1**. 

15. Task Ho. 15. 

16. Task llo. 16. 

17. Task ::o. 17. 



accesses to file 12 
processing required, 
accesses to file 12 
processing required, 
accesses to file 9 
processing requi red. 
accesses to file k 
no processing required, 
accesses to file 9 
processing required. 
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THE ll!TEP>"AL KMOVLEDGE OF ST1TE 
Dr. Miroslav Valach 

I. 1NTR0DUCTICM 

The internal knowledge of STITE integrates information necessary 
for the processing of given requests into a multipurpose structure designed 
for facilitating both retrieval and processing data contained cither internally 
in STITE or externally in the centers to which STITE has access. 

Among the purpose for its creation and Its highly structured repre- 
sentation in STITE are: 

1. To facilitate identification of mutually related elements 
(documents, keywords, topics, files, descriptors, authors, concepts, 
etc.), where the relationship between the elements can be specified 
and created as a consequence of dynamic growth and use of the system. 

2. To provide a data-base for an on-line question-answering system 
that enables the user to utilize STITE for Interactive presentation 
of refined views on given areas and for links to existing literature 
or other documents by giving, either specifically or generally, the 
desired point of view. 

3. To locate information relevant to the request, be it In internal 
or external data bases. One of the important parts of the structure 
Is the linking of items with bibliographic and other documents or 
sections of documents. The basis for this is in the use of general 
thesauruses or indexes and glossaries contained In individual (or 
selected) documents. 

k. To provide for services to educators for the structuring of 
courses, for specific relationships among given topics, concepts, 
and documents, in which internal knowledge plays a substantial role 
In adequate treatment of the request. The more automated and 
demanding the process, the more important is the use of Internal 
knowledge. 

The attractiveness of highly-structured internal knowledge lies in 
the fact that once the effort to creat it has been undertaken, it provides the 
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basis for dynamic; automatic growth of the system and provide* a uniform base 
for nanlfold use of the knowledge; for the najorlty of the requests, while 
differing In their specific requirements, still refer to the common internal 
knowledge. 

Procession of unspecified tasks, for search by STITE or by the user, 
in a way that allows the user to shape or create his own approaches In cooperation 
with STITE is another feature of highly structured Internal knowledge. 

ALGORITHMS FOR THE iMIPULftTIOl] OF THE INTERNAL KNOWLEDGE OF STITE 
Analysis of the topics considered for use with STITE shows that there 
are primarily four elements of a response to a request. 
). Internal Knowledge 

Internal knowledge of some kind that must be questioned or used 
as a guide for processing the request Is necessary In STITE. The level of 
sophistication of the internal knowledge of STITE will parallel the level of 
sophistication of the reaction to the request. Therefore, It is the Internal 
knowledge, its structuring and the technique of Its use that will primarily 
determine the efficiency and the reactlonal characteristics of STITE. Internal 
knowledge will be a common base for both automated request process.ng and ,nter- 
active request process ing. 

2. A Special List of Items Link ed to the Internal or External 
Knowledge of STITE . 

A list of the Hens that are to be found Is given specifically 
by nan. or descriptor or a more genera, term that is more specifically defined by 
the process. The basis for such activity is the internal knowledge of ST.TE that 
is linked to specific Items contained In the request or Identified Indirectly 
where the special identification is again made by use of the Internal knowledge. 

3. Programs 

Programs will manipulate Internal knowledge and Items linked to 
tntemal knowledge and that ore of general character, such as linking cx.sun, 
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Pledge by . new descriptor, and finding neighbors or areas of a certain node 
(conccot, document, keyv.ord, etc.). The programs are in one way or another used 
for the benefit of most requests in adequate preparation (creation and manipu- 
lation) of the internal knowledge. 

One typical such program is an extraction of certain parts of 
internal knowledge for the purpose of refined structuring in isolation from the 
whole structure, providing for "a refined interface structure" with a wide data 
base* 

4. Special Progress (subprograms, Subroutines) Specifically Written 
For a Particular Reoucst . 

Such programs that are inevitable in a system like STITE form a 
library of STITE programs, special capabilities that are the core of the dynamic 
development of the system. 

Thus there are two bases of the growing "intelligence" of STITE: 

1. growing library of programs 

2. growing internal data base, its structuring and use as 
internal knowledge. 

AU Transformation of a content (book content, document content) 
Into a content tree structure. 

AU transforms the table of contents TC of a document into a 
tree structure (See tree structure for reasons and use). H the input of the 
content is manual, organizational markers can be agreed on so that All can 
easily recognize chapters, paragraphs, examples, introduction, and glossary. 
K input from an existing tape comprises the markers, markers should 
into desclptor file 0,. and manipulation for structuring should be donved 
from it so that All retains its generality. 

If. on the other hand, the tape does not hav* organization., I 
markers, a special recognition subroutine must be attached for •^""^ 
markers. Otherwise interactive manipulation, (using cx.st.ng e , - ■ 
for a given computer) can be uti.ized to review the tape and es.abhsh tu 
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It is not anticipated that all documents villi be processed by 
All, especially if the document does not contain the markers or is not in the 
form for automated input. 

On the other hand, there are basic books or articles for certain 
areas of knowledge that should be part of a detailed structuring for the creation 
of an adequate internal knowledge of STITE. In such a case, all efforts should 
be made to input (manually) the table of contents or an even more detailed 
structure into STITE. 

It is proposed that in each area of knowledge there be an expert 
responsible for the content of the internal knowledge of STITE in that area. 
This expert will monitor not only external enrichment of the area but also the 
formation of an internal cluster of knowledge for that particular area from 
the internal resources of STITE and eventually from the statistics of the requests 
In that area. 

AL2 Transformation of concept structure Into concept tree 
structure. 

Reasons and advantages for such transformation have been discussed 
elsewhere. How feasible it will be to make this transformation by a computer 
algorithm still remains to be seen. To create AL2 for general input data seems 
to be behind the state of the art today. However, it is acceptable In the early 
stages of STITE that the transformation be made by human beings or that it be 
extracted automatically from existing descriptions where the existing organiza- 
tional structure of the presentation of the concepts in the corresponding document 
will be used as a basis for the tree structure. Pask's studies for , CASTE system 
show that the creation of a large concept structure requires human effort. There 
have been no attempts to transform such a structure into tree structure automa- 
tically. The closest approximation to this type of work is automated abstracting 
which, at this stage, does not have satisfactory results for application for STITE. 

AL3 Transformation of the tree structure into linear sequence. 

Provided that there is given a format for each level by which 
the nodes of the level are to be ordered, AL3 is a relatively simple alt;,or i thm. 
It Is to be expected that the representation of the tree structure In STITE will 
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have special character due to the n-ring approach, and therefore AL3 will 

have to be adjusted to it. However, no special problems are forseen for writing 

AL3 as a program. 

AL*» Formation of a ring for a given descriptor. 
Two versions are required, A and B. 

A-vc rsion Nodes of the structure have d-descriptor in P form, 
transformation PJ is required to create R-form. (See VI, Aspect 2) 
B- vers ion R-form into P form with d-descrip.tor. 

The program itself is a short program with, however, a sophis- 
ticated way of string processing techniques. It requires some experience in 
string processing and adaption of current techniques to multi-link versions. 

It is to be expected that after . testing, modifications will be 
required.' Also additional modification or even substantial revision is likely 
to come after larger structures come into use. The algorithm will necessarily 
be dependent on the linking technique, as well as on the total approach to the 
structural representation of internal knowledge. Any change will very likely 
affect AU, which is to be anticipated in advance as a necessary step in research 
and development of STITE. 

Experiments and evaluations of effectiveness will have to be 
conducted gradually during different phases of implementation, especially 
under the condition of a larger structure. 

One of the critical spots will occur when the larger structure 
must be processed for extraction and/or isolation of a certain area in which 
some of the links with the sourcc-data-base is to be maintained while others 
are to be interrupted. (Transfer made at higher levels may not require inter- 
ruption while transferred lower levels of the structure will.) 

AL5 formation of the tree structure from given descriptors. 

AL5 occurs in case of a course outline where various units of 
knowledge arc to be grouped into smaller and larger groups and ordered within 
each of loom. 
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It requires that some format be given, that the format contain 
given descriptors, and that items of the request be associated with the descriptors 
of the format. 

Some clarification in the area of association of descriptors with 
the content will still be required. In the area of course outline, Where topics 
and subtonics, exams, number of lectures, and other organizational groupings seem 
to be clearly identified, it does not seem that AL5 will have substantial problems. 
However, automated orderings or groupings of the topic require a closer look. 

AL6 Location of given subtopics in the data base. 

To find subtopics in an external data base that does not have 
detailed links with IKN of STITE involves using conventional search techniques 
which are available at the particular site in question. AL6 In this case just 
transfers the request to the external source and receives in resolution level 
the answers that it cannot control. 

In case of the use of IKN (internal knowledge), there are three 
ways to find the subtopic. 

1. by the descriptor of the subtopic - following corresponding 
rings, branching in each node, looking for neighbors 

2. by associations created in the sources of glossary (neighbor- 
hood or other relation) 

3. by associations created unconventionally (ad hoc for particular 
purpose in D^) 

In all three cases the basic question is to locate neighbors of 
nodes located along the same ring. 

No special problems are anticipated in programming techniques. 
However, how such a search will be controlled must be determined and how many 
neighbors to look for, how deep to go in neighborhood structure, and how to 
identify relevancy must be decided. AL6 still requires close attention from 
the algorithm point if view. 

AL7 Formation of a cluster from given set of subtopics 

AL7 means that there are missing subtopics that have to be both 
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.ocntificd and located to conplote the cluster. Control of such a process 
1 1 have indicated r.ore specifically (or as options chosen under see ru es 
has to have maica everything In, subclustcr 

what it raans to fora a cluster, i.e., chain 
with all connections in uhat resolution level. 

Specifications for AL7 require further study. U Is likely that 
some experimental type of research will he necessary, not only to formalize the 
approach, but also for practical aspects of the problem. 

ALO Location of documents that contain a given topic. 

,f the topic is part of IKH. it will be found in refined resolu- 
tion leve, specifying the location very precisely on the sub-document l.vc. 
General IV this shou.d not be any problem since it is assumed that links to the 

or are formed whenever a new document is Included or new 

structures arc formed. 

Ho special requirements for AL8 are forseen. The use of the 

,„h n - structure will be much the same as in other 
thesaurus, glossary, and D L structure 

a , 9 orlthms. AU8 may be subject to modification similar to MA. 
degree. 

M Location of documents that contain relevant theorems on a giv*n 
topic. 

This question could be very difficult If relevancy is to be 

,h,n bv a descriptor of the theorem. The question 
determined in some other way than by a desenpto dlf f!cu1t, especially 

r, rrr ;:xr/.;irr. ~ — - - - 

and relevancv Is meant as application of the theorem. 

State of the art requires that either the descriptor of such a 

.1 *t At o k#» answered on on inter- 
theorem be made manually or that the whole problem of AL9 be 

active basis. 

,f Wiemcnted interactively, the system can be very useful ,n 
IT im[ lui.iuin.^ „„ nnt . :f u has been- structure 

retrieving theorems and/or related portions of the document ,f 

In such details in IKN. 
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H is anticipated, however, that theorcns are parts of 9 >ossarios 
^.tnino necessary descriptors or clues. They can 

e niv^n nart of data base relevant 
AL 10 Location of all pictures as g.v.n part 

to given topic. 

traced by keywords or descriptor links 'o the 
PiCtU r S 7ch P ; or thro U the descriptions of the picture 
headings of paragraphs - / ^ 5 ° 9 § a|qof|thm requires still further 

(text under the picture, linked D^J . 

consideration. 

^ Pars e out structures relevant to a 9 ivcn topic fro. a 9 ivcn 
glossary. 

This problem is similar to AL7. 

,„. T^jm^ 

KNOWLEDGE . , 

t. - jt -,1-r.r brtween existing data 
«f <;t.TE is to be a mediator unuw-*. 
The pr.nu.ry purpose of ST Ti , ucator wh0 „ sccrchi n 9 

basos as the outside knowledge of STIT and a ^ ^ 

for relevant answers to quests , - W - ^ ^ 

^t would not be satisfactory. * , ( „ n be , a „d nuny ti,es 

Ea ch of then, has lower nodes such a , w! „,,. acC css to the 

(, yp ,ca„y tree structures by location . ,u*o . u ^ 

Ration by any of th- Indexes is )oMtton of the document in 
The search is indeed a tree structured search ^ ^ 

5hclv es by topics a g ain use, tree structure, each 1 ^ 

• „, „ > ht , trGC structure opproacn k 
It Is proposed that the tree stru 



process and extended below the level of document, i.e. that the Internal organi- 
zation of documents (bocks, articles, journals, abstracts, chapters, paragraphs) 
be regarded by STITE as a tree structure (which it in fact is in all documents) 
and that it also be represented as a tree structure for the internal use of 
STITE in its internal knowledge whenever convenient or necessary. 

This approach will enable uniform processing of information in any 
level, regardless of its size, whether it be a group of books under the same 
topic in a higher level of organizational hierarchy or a special paragraph of 
a document or theorem in a book or sentence in the most refined level of the 
hierarchy. 

The system will be able in this way to process information on mutually 
different "levels of resolution" without the necessity of adjustment of the 
algorithms to each level. 
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Information Centers, Libraries 
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Departments 



All document organization 

(More trees imposed on th, same 
data base are indeed possible; 



Single document 



6 o ° 



0 o 



Chapters, 



bibliographic data, etc. 



Paragraphs, examples, any beddings 




Sentences 



© © 



Words 
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It is true that whenever a concept or unit of knowledge Is to be 
presented in the form of natural language, the presentation is first trans- 
formed into tree structure and then linearized by formation of paper, book, etc. 

U would be ideal to represent all units of knowledge, associated 
thoughts, concepts, or other information groups in the form of a tree structure. 
One such approach is offered by the concept of system as being composed of 
elements and relations. If concepts or units of knowledge could be regarded 
as systems of the same kind, it would certainly be possible to represent them 
meaningfully as tree structures. Additional attention will have to be paid in 
the future to this question. 

One of the biggest advantages of tree-structure representation is that 
it provides for very effective manipulation of information at a given level without 
destroying upper or lower level organization, e.g., chapters can be reordered with- 
out touching paragraphs, merely by changing the linking among chapters. Everything 
else remains un touched • 

It allows reordering of levels, insertions or deletions of the nodes 
(with or without the whole structure in lower levels). It allows use of the 
same node with the same substructure (subtrees) in more than one organization 
or removal from the organization with the whole subcontent and placing it into 
another organization merely by changing the links leading to the node and out 
of the node, e.g., if a certain topic is prepared for a graph theory course and 
later it is decided that it will be presented also in the course for network 
design, all structure below the node can be transferred automatically by merely 
changing the linking of one node. In addition, all remaining links, such as a 
bibliography for concepts included in subnodes, linking of keywords, references 
to associated concepts, or glossary linking, remain untouched and are transferred 
autonatlcilly. 

This Is Just one obvious example of the thrust in effective manipu- 
lation gained by the fact that the organization of the Information In the internal 
knowledge of the system follows the accepted' tree structure organization of willing 
docuittents. 



ERIC 



27 



The scries of figures, Fig. 3 through 6 t show in concrete detail 
various levels of existing organizational hierarchies of information. The 
figures show the levels and attached descriptors (that can be either special 
for a given level or portion of the document or common for more than one docu 
ment) . 
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Storage Of And Reference To The 
DATA BASE Theorem **-17 

UKN * UNIT OF KNOWLEDGE 
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Fig. 5 



Unit Of Knowledge UKN 




500 



List of Classes of UKN 



35 Definition 

36 Theorem 

37 Paragraph 

38 Picture 

39 Concept 
kO Book 

h\ Document 



1. Where Is It stored, bibliography 

2. Difficulty measure 

3. Primitives (elements) 

A. Relations among elements 

5. Name 
Language 

6. Double decimal classification 



Descriptors, definition of classes 



for identification 
-> for cataloging 



Fig. 6 
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Course outline is one of the typical requests of on educator; the 
response to the request is shown in Fig.?. It can also be represented as a 
d ocu,ent that is a tree structure fro. the point of view of its 
lt differs fron other documents by neaning (descriptors) of the nodes .. wh.ch 
,t is specific. However, any deletions, Insertions, ordering, or other operations 
on the course outline do not differ froo organizational operations on any other 
document and share the algorithm for the processing of the tree structure organ- 
tzation. 

Course outline can therefore be looked at as an enpty tree structure _ 
ttat is filled with pointers to the descriptors, concepts, modules bibllogrop ,es, 
and exauples fro, the request directly or fro. the Interna, know.edgo under the 
guidance of the request. 

As always is true about tree structure, the course outline »•«"»' 
ke processed serially. Different nodes of the tree structure are ,rs < : ass , , d 

by the request, i.e.. examp,es, definitions, concept veys. The substructure 

Ir he node is then filled in independently on other parts of the tree. Proper 
Merarchy of the nodes is estab.ished and Kept while the tree structure can be 
unfolded later as an ordered string of nodes. 

Given tree structure represented by use of ♦ and • as del Ineators 
for paraellel and serial nodes, then 

a, a 2 Uj ♦ a^) ♦ a & (a ? + a,) + (a, ♦ ',<)) a l 1 °1 2 

. „ a In operational level 

Permutations can be made on nodes a 1Q . • • • a 12 

of the expression, independently of each level and sub, eve. In * tree. 
Pernutations take into consideration precedence re,at,onsh,ps cstabl.shcd f 
Tkledge of combinations of concepts. ^^^2^ 
of missing Hnks a«ong requested concepts, etc. Also. uggesUo 
r -uest preferences based on various statistics, expenence, or othe su. es. 
nnkld ; 0 the Particu,ar area of the know,edge can be taken Into consider. , on. 
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V. ASPECTS AMD EXAMPLES OF DESCRIPTORS 

Descriptors arc node classes of the nodes in the structure of internal 

knowledge. Let N be node of the structure S |t , M> then d will be the class (given 

Ii\N * 

by descriptor d) and dN class of the node N. 

There are five aspects cf d that need to be considered: 
A spect 1 . 

d is a class given by so called descriptor (D) , where Dd is a descriptor 
of the class d. To assure high flexibility in formation of Sj^ and its effective 
use, Dd is an element of a list D L (unique list of descriptors of S^ or special 
list with deliniated validity for restricted area). If a node is to be classified 
by dp f it is always done by a pointer that points from N to D^. 

Aspect 2 . 

If It is desirable, and the same descriptor dK Is used for more nodes, 

i.e. 



N 1 j< N 2 i* 



then 



nodes Nj, U^ f . . . are joined Into a ring Rd then is In fact a file 



connecting all nodes of the same class in a cyclic-link with D^. 

Example: Case of desirable ring (file): descriptor dj - "coloring 
problem as a problem of graph theory. If 

d l N l " d 2 N 2 • • • • e d > d c D L 
then pointers 




(A1) 
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With proposed double-ring concept, any node can participate in as many rings 
at the same time as is practical. 

Symbolically, the forms Al and A2 can be described respectively as 

a d,*, -<V - d e D L s P(N r N 2 , d) 

, . ohi m d) The operation RT that transforms 

as points form P, and ring as R(N,, N 2 , d). The op 
P - form into F - form can be called "Ring - transformation or RT. 

R(NjN 2 . . .d) 2 RT(P Ol,M 2 • • -d) 

~:„*«r« into ordered files In which 
RT operation transform one-way po.nte , n cr 

not only the Cass of the node can be accessed, but also, ..«. 
nodes having the class can be accessed too. 

o ,„h P forms should be combined 
For reasons of bath-way effcctlvc.es « n f » ^ 

for practical purposes. If the file is too b, , , . - 

the class. PR " form l» called a combination In which such r.mj 
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that each nth node contains a pointer to d, as illustrated below 

d 




Fig. 10 

More elaborate and more effective ways can be devised and will be 
considered in actual design of the memory structure for programming. 

An example of a descriptor that does not need a ring is descriptor 
d = "Chapter". Given the node representing a chapter P - form is sufficient 
since it is very unlikely that anybody would want to trace all "second chapters" 
of the books in question. • 

Aspect 3 * 

In case that $ m is used for a new request, it might be desirable to 
create a new descriptor for certain nodes, i.e., nodes have to be represented 
In such a way that new descriptors can be attached. Be it in P or R form, the 
concept of double-ring has been formed in which all descriptors attached to N 
form their own rings of descriptors N. Let d ] . . . d p be all descriptors of 
N so that 

djN * d 2 N i d 3 N * 

Then N(d r d ? , d 3 ) is a set of descriptors of N. The set is represented as a 
cycle of links attached to N called N-ring of N, where P or R-pointers are 
attached to d,, d 2 . . .d as illustrated below. 



N 
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Here P is P-form pointers and R is R-forn pointers, and both are in the some 
N-ring. 

Aspect *> . 

Any descriptor rust be represented In such a way that it can not 
only be retrieved, but also recognized. Whether it will be done by ring-matching 
in STITE or by sor.e reference rules or • 'me ta -descriptors" will be determined by 
the degree of sophistication of the system. In any case the double ring concept 
(that 'can be extended to n-ring concept) will provide a sufficiently adequate 
base for any later expansion of the system in this direction without any need 
for reprograrsilng or restructuring of the internal data-base. It is, however, 
important that the n-ring concept be accepted from the beginning, if not used 
immediately. 

Aspect 5 . ' 

It will be advantageous for the processing in STITE for the descriptors 
to have their own associative structure that is determined by users or by recom- 
mendatioru . j 

Descriptors, forming a file of a system, can be structured Independently 
of its current use, since the structuring process means addition of links or rings 
to D (which does not have existing links if accepted and Incorporated from the 
beginning). Thus D can have its own thesaurus or glossary - like structure that 
will allow an amount of freedom in the selection of descriptors by the user. 
Descriptors that are not precisely known to the user can be located or discovered 
by the user in interactive-node. 
Examples of descriptors for course outline: 

State of the Art 
Lecture 

Course Out 1 ine 
Quiz 

Examination 
Text 
Theorem 
Proof 



ERIC 



Exp Innation 
Appl i cation 
History ~ remarks 

document 

development 

data 

Term Paper 
Ass ignr^cnt 
Home 1/ork 

Problem — solved 

unsolved 
solution 

Formal i 2a tion 
Format 

• 

This tentative list indicates that there is a great deal of room for the Internal 
structure of descriptors. 



VI. CONCEPTS 

In the context of STITE, the word, concept, is to be understood as 
a unit of knowledge that is defined by either definition or description and 
which structures the concept by relating it to other concepts. 

Using D for definition or description, D is quadruple 

D C S fc D' V {C M } r ' {R C }) < C D 

where Cp is the defined concepts, C y are a set of concepts chosen by the 

definition as primitive concepts of the definition, R is a set of relations 

c 

chosen by D c , and R Q is the relation of the description to C^. 

Concepts arc basic units of knowledge stored in STITE for processing 
knowledge for the varicus purposes ?iven by requests. 
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For use in STITE, It is desirable that concepts be Structured in such 
a way that their definitions or descriptions can be accessed either as a whole 
(CI) or separately as each component of (CI). This offers the following advantages: 

1. Processing of the requests is refined. 

2. The system is enabled to associate components of the concept 
with supplementary information (bibliography, descriptors, other 
data relevant to the use of the concept in STITE). 

3. It allows the concept to be linked into various files by Itself 
or by its components. 

k. The algorithms that process the concepts for various requests 
are s impl i vied. 

5* The effectiveness of the algorithms is increased. 

6. Easy access to the concept is provided by the relations of Its 

components. 

In many ways a concept can be represented as a structure. STITE 
proposes that it be done by using the so-called undesignated tree structure. 
"Undesignated" means that the nodes of the tree do not have a specific class 
or Interpretation given in advance. Each node has Its interpretation given 
by a link to the descriptors, in this case to the concept descriptors, where 
the descriptor represents the class of the node. In this way classes of the 
node are input data to the system so that much flexibility of the system Is 
gained !n terms of the Independency of interpretation of Internal structures 
of the system. 

Having undesignated structures, algorithms for the structure processing 
need not depend on a particular interpretation of the class of the nodes. All 
data organization of the system is flexible and can be different for different 
areas of knowledge, different areas of the use, and different areas of users. 

It Is, then, the organization of the data that has to be properly 
prepared. If the processing of certain data becomes inconvenient, then It Is 
data reorganization (eventually automated) that Improves the situation rather 
than a rewriting the system for new algorithms. 

Fig. 12 Is an example of the use of undesignated tree structure for 
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thc representation of a concept. Uterpretation of a node Is given by a l!,k 
to the descriptor fron the list of concept descriptors. 

Fl9 . ,3 shows the descriptors of the "concept". It Illustrates the 
rw of the reuresentation where meta-language and m eta-structures are 

::;:ii;:id L iTste, bY *. - ~ «* 




i) 

i) 
i) 



1) Concept Cq 

2) Definition D c 

3) Description (C m , R c ) 
It) Concept nanc or symbol 

5) Conponcn ts 

6) Relations , . 

7 ) Prinitive concepts (of the definition or desenption) 



Fig. 12 
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Metaconcept 




1. Concept 

2. Definition 

3. Descriptor 
h. Concept Name 

5. Components of the Concept 



6. Relations 

7. Primitive Concepts 



Fig. 13 



VII. JUSTIFICATION OF THE REPRESENTATION 

Any concept is a structure consisting of nodes and relations. It 
is necessary to know the nodes, their relations, to have them represented, 
and to have them described. All of this is provided for in the undesignated 
tree structure by the nodes of tree branches (lower level nodes) that can be 
expanded according to individual requirements by the nature of the represented 
concept. 

The nodes can be indicated from various places of the data structure 
of STITE. Once indicated, it can be determined by what element is pointed to 
by Its descriptor, by the lower level associations related to the component 
by following the tree down to a lower level, by tr.e concept it belongs to by 
following the same level links or by the related concepts under the top-node 
concept by following the sane level links. 

There U, however, also a need to have the ability to point to the 
whole concept, i.e. to have access from the concept as such to Its name or 
elements. It is the top node that provides for the representation of the concept 
In the lower rcsolutioi level (level with more suppressed details). 
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The tree structure method of representation automatically provides 
for a very important feature of the data structure. The processing algorithms 
can utilize "concept" in various resolution levels, from one-node representation 
of the concept to most detailed handling, without changing or restructuring the 
data base. 



VIM. STATE OF THE ART (SOFTA) 

1. Identification Of The AS? A Of SOFTA 

1.1 By keywords, short description of area in natural 
1 anguage 

1.2 Detraction of : keywords, relations, structure of the 
area from the description • 

1.3 Extension of the area by: 

lexical relation 
associative structure 
thesaurus information 
science class? fication 
by using other sources of 
cohesions 

2. Search For Information On SOFTA. Using AREA 

2.1 Group internal resources of B 

2.2 Group external resources (external nodes of B) for 
authors, headings, titles, bibliography abstracts 

All of them being additional resources for extension of AREA, in which 
extension also links are made and preserved toward the literature sources 
(literature, authors, texts, unpublished materials, opinions of contacted 
professionals, etc.) 

2.3 There is a feedback there: whenever AREA is updated the 
whole AREA is used for further search. Limits have to be 
established as to how far to go in which direction. When ARFA 
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is established it must be formed on much wider ground but 
includes the neighbor area also comprising nodes of areas 
that are not to be . od in or expanded in the final report. 
A process of finding, identifying, or establishing stopping 
points has to be at work at all times. 

Conoj lotion Or Extended A REA 

3.1 Collected information in AREA is analyzed 

3.1.1 Transformed into structure with classified nodes 
(node classification algorithms NCA) 

3.1.2 Optional grouping of nodes (structures partitioning 
algorithms SPA for minimal interconnections) 

3.1.3 Substructure untangling for the determination of the 
order of the paragraphs, sentences and other elements of the 
report (structure untangling algorithms SUNTA) 

3.2 Transformation of the substructure 

3.2.1 Into sentences, if detailed report with fluent 

text is desirable (structure to fluent text transformation 
algorithm SFTTA) 

3.2.2 Into tables ov names for enumerative type of text 
(structure to enumeration algorithm SENA) 

3.2.3 Into pictures (structure to picture algorithm STOPA) 
3.2.* Into other fo.*s serving as surface structure of the 
substructure 

3.2.5 References of the source 
. Generation Of The Whole Rcpo -* , Tcx^ Article. Dook 
k.] Content (content generating algorithm CGA) 
k.2 Text (use of 3.2) including references 
4.3 Bibliography (bibliography generating algorithms BCA for 
uniform and ordered bibliography 
k.k Other cdi ting 
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LITER ATURE SURVTY 
Dorothy $• Hughes 



|. INTRODUCTION 

|„ order to achieve its purpose of designing a system to transfer 
scientific and technical Information into a learning system, the STITE project 
wi U identify some existing learning tools and systems and the methods used 
in desiring them and will delineate tools and systems already operative in 

various areas. 

To dale, the following sources have, been searched: 

BjbHogr^ c£ Cur^ 1968 - 1970 

Computer Abstracts - 1563 - date 

CjjrretU J_ndex to Journals^ j_n Edjjcatj£n_ - 1970 - date 
Educational Index - 1962 - date 

j^nrn^of Educational Data Processing - 1971 - 1972 
Remaining anx>ng the major sources to be searched are Com^ujing Reviews. 
Computer and Control Abstracts , Infon^on Science Abstracts, Information 
^^.l^i^stra^, Series^C, and Goj/ej^nment^ Reports^ Ajinoujic^mervts^, 
as well as other bibliographies and indexes. 



II. DEFINITION, OF LEARNING TOOLS 

The term, learning tools, could include any of the traditional aids to 
teaming, such as text books, flash cards, or work books, but for the purposes 
of STITE the definition will be limited to those instructional materials 
Involving some kind of automation or computer activity. Included in this ^ 
definition could be computer-assisted instruction, computer-managed in.truet.on, 
automatic teaching, programmed instruction, television, filmstrips, tapes 
teaching machines, and other media. Thornton and Brown (Ref. 106), In the- 
book, New Ked^ on^ Collcac Jc«^, ll.t the varieties of tools and system 
that are within the scope of the STITE project. 
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I . SYSTEMS APPPCACM TO^ CURRICULUM DESIGN 

A recurring there in the literature of education is the importance 
of course design and curriculum planning, and with the application of tech* 
nology to education has cor.e the possibility of applying the systems approach 
to the area of curriculum design. 

The systems approach first evolved as a method of solving problems in 
engineering and business and usually involves defining the elements of entry 
behavior of the target population, problem ident i ficat ion, task analysis , 
development, selection, and sequencing of media and materials, and an evaluation. 

The elements, or steps, can be utilized in curriculum design, and this 
approach is significant for the STITE project in the development of the pro- 
posed descriptive model. At this stage in the literature search, the references 
that follow seem significant. 

Stolurow (Ref, 99) > writing of the psychological aspects of computer- 
assisted instruction, presents the teaching-learning process as one that does 
permit the development of an instructional system and describes his use of 
SOCRATES to conduct research relating to a model of tutorial instruction, to 
study basic variables relating to learning and the transfer of learning, and 
to develop a technology of using a computer based system to generate learning 
materials. He also describes some of the psychological principles, such as 
social reinforcement and paced conditions, that ought to be applied in the 
development of learning systems. 

Cyrs (Ref. 25) > maintains that the systems approach to curriculum design 
increases effectiveness by requiring precision in the definition of educational 
objectives and then by redesigning the entire educational process in order 
to ensure achievement of the specific goals. He develops a flow chart to 
illustrate the process. 

To describe instructional design as a series of steps is a common method 
of explaining the process, although not all writers agree on the number or type 
of steps necessary. Knirk (Ref. 57), names six components, those of goal deter- 
mination, analysis, prescription, implementation, evaluation, and revision. 
Tuckman (Ref. 109) > says that the process proceeds in a systematic way, is 
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relevant to its parts, and deals with measurable behavior. Hunter (Ref. 52), 
lists seven steps in the process of preparing programs for military technical 
training. Parry (Ref. 79), in addition to giving the details of the procedure 
by which programmed instruction is prepared and illustrating the process with 
a flow chart, suggests external and internal features on which a particular 
program can be evaluated. Felhusen and Treffincer (Ref. 3*0, define steps 
in design as the analysis of concepts and principles to be -aught, formulation 
of objectives, and choice of methods to be used in achieving the objectives. 

Hansen (Ref. 50), describes a systems approach model for CAI curriculum 
development at Florida State University and documents his experience with 
instructional strategies there. Decker (Ref. 2o) , explains his learning model 
with the components of a class assembly, a learning laboratory equipped with 
printed materials, audio-tapes, filmstrips and other media, and thirdly, feed- 
back sessions using self-tests and quizzes. 

Boblick (Ref. 8), outlines a three-step process that a classroom teacher 
may use to develop instructional segments for classroom use. 

Bunderson (Ref. 12), describes an instructional design model and a learning 
task which was designed and developed in accordance with the model. 

Oliver (Ref. 77), pleas for more organization in the goals, methods, and 
instrumental procedures with which the designer must deal, while Banathy (Ref. k) , 
explores the relationships between sources of information, curriculum design, 
and student achievement and uses several diagrams to illustrate this interaction. 

While Williams (Ref. 117), writes of engineering education, his chart 
of the learning operation, showing various channels of communication that affect 
that operation, is valid for any subject area. 

Most writers emphasize the importance of defining educational goals in 
curriculum design and Brown (Ref. 11), suggests that most educators tend to 
confuse the goals of a course with its content. He, as well as VanderMeer (Ref. 
112), speculates that new media and methods may make It possible to achieve a 
wider range of goals In the curriculum. 

Ammerman (Ref. 2), identifies some of the problems in developing learning 
objectives and concludes that successful objectives nust be based on factors 
that Influence their mcaningfulness and their usefulness. Mager (Ref. 69), stresses 



0 

ERIC 



48 



the importance of defining what is to be taught and what .measurable behavior 
is to be expected at the end of the course. His book is written as a program 
itself with instructions for working through it. 

Montague (Rcf. 7*0, emphasizes the necessity for being specific about 
behavioral objectives an;! says that passive words such as "know" and "understand" 
should be replaced by words like "construct", "identify", and "describe". 

Rosave (Ref. 39), maintains that educational objectives should be defined 
in terms of the requirements for life in the world rather than life in the 
isolated classroom. Eiss (Ref. 32), requests more attention to goals and strate- 
gics in planning science curricula, and Robinson (Rcf. 86), v/riting of science 
education, appeals for new approaches. 

Writing of engineering education, l/aina (Ref. 116), demonstrates a method 
of specifying educational objectives by specifying what an engineer is expected 
to know how to do, and this method is valid for other fields as well. 

A systems approach to curriculum design must alio.; for individual differences 
in students, and Burke (Ref. 13), emphasizes the importance of a system that allows 
each student to follow his own direction and fulfill his own goals. Stolurow 
(Ref. 100), maintains that a successful instructional program must handle three 
variables, i.e. who is being taught, what is critical, and how the teaching is 
to be done. Cohen's (Ref. 21), list of priorities for curriculum design includes 
differentiated student curricula, media, grouped or individual curricula, and 
teacher roles. He (Ref. 21), also stresses emotional, as well as cognitive, 
needs of the student. 

Mlzenko (Ref. 73), describes a tutorial model that provides for the 
accommodation of high, middle., and low aptitude students. 

Smith (Ref. 95), considers factors that bear on training effectiveness. 

Motivation is an area that requires more careful investigation, and a 
systems approach model should incorporate both effective, as v/el 1 as cognitive, 
learner variables in design, according to McConbs (Ref. 67). Filip (Ref. 35), 
emphasizes the humanistic dimension in planning instruction while Woodson (Ref. 
118), concludes that the most important outcome of computer assisted instruction 
may be what it teaches educators about the instructional process. 

A model for revising materials designed systematically for education, 
as it Is described by Rayncr (Rcf. 85), is significant for the STITE project 
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for revision or updating con be on important feature of the proposed model. 

|V. PROGRAMMED INSTRUCTION 

Forerunner of present-day, highly sophisticated instructional systems 
were the earlier and technically simpler teaching machines. While many of 
these machines, because of their simple end non-automoted configuration, would 
not fit into the STITE definition of learning tools, they are nevertheless of 
significance for STITE because of their historical role in the development 
of computer-assisted instruction and because of programmed instruction techniques 
that were developed for use with them. 

Margulies (Kef. 70, defines programmed instruction and gives some util- 
ization data, such as costs and availability. Calvin (Ref. 20) describes some 
of the hopeful aspects of programmed instruction. Fry (Ref. 36), presents 
the historical development of teaching machines, along with some discussion 
of practical problems, while Garner (Ref. 38) describes the chronological 
deve4opi4cnt of programmed instruction. 

A state-of-the-art report, on automatic teaching is given by Galanter 

(Ref. 37). L 

A comprehensive reference source on teaching machines and the techniques 

of instruction associated with them is provided by Lumsdaine (Ref. 64), who also 
surveys current activities and trends (i960). 

More recently Dunn and Holroyd (Ref. 30) , edit a volume on the proceedings 
of a conference on programmed learning and educational technology that gives 
a comprehensive review of the present state of educational technology (1968). 

Cram (Ref. 23), explains teaching machines by arranging his text in a 

"scrambled book" form. 

A good discussion of the psychology of learning and its relation to 
Urchins machines and program preparation is given by Austivick (Ref. 3). Oeterline 
(Ref. 29). ano Lumsdaine (Ref. 63), also take into account learner behavior and 
its relationship to the teaching effectiveness of programmed instruction. 

The technique of writing good programs for programmed instruction is 
described in detail by Lysaught (Ref. 66). -.nomas (Ref. 105), after delineating 
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the step* in program writing, then illustrate* those steps in programs on 
Itentary .lle.rte.ty and Pythagoras' Theorem. Kay <Rcf. 55). also descr.bes 

oroqram writing techniques. 

The persona, charaeteristics of a successful program writer are deer, bod 
bY Smith titer. 9*). as well as the charaeterist.es of a sueeessful program. 

Calender (r.cf. 1?), writes a handbook-type manual as an Introduce .on _ 
a „d reference text for those instructors using programed learning or «,».<.« 

courses for profirr.".T.ed learning. 

Gilbc t (Ref. te>. relates programmed learning to university instrac ,ona 
S erv.ee! by classifying the Instructlona, needs of students, faculty, administrate, 

and research s to f T • 

Unw.n (Ref. HI), and Tobin (Ref. .07) bath present reports on end paper 
fro m, conferences on programmed learning while MacDonald (Ref 68). 1 ,st omm 
ci a, firms engaged in the development of teaching ^chines and programed learning 
materials. 

V. C0HPUTER-ASS I STEP 1 1 'STRUCT I Oil 

With the introduction of computers Into the area of Instruction in the 
, atc fifties and their increased popularity and usage in the sixties, there has 
also arisen a considerable body of literature and information concerns the 
11, scope, possibilities, and problems of computer assisted ,nstruct,on. 
WMle it is not necessary for the ST.TE project to invest.gate all of t csc 
wr tings, it is desirable to examine some of the more significant one. .n o dor 
I er .ne the context within which the ST1TE system might possibly func ,o„. 
far the literature search reveals the items that follow that see. to be 

particularly relevant. 

Z.nn (Ref. 121). gives a good overview of the develop^ and d.rec 
of instructs. f es of computers, as do Silvern (Ref. 53). and > 
S 8). Zlnn (Ref. T2O , defines and describes the.r purposes and modes « c n 
d cation. Suppos (Ref. .02). writes of the advantages of types « , p e o uter 
, ntc raction CAI affords (I.e. drill . practice, tutorial , actual 
also (Ref. 101). describes seme current activities and some projects th. 
future. 
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Gerald (Ref. { *0) , reports on on early work shop conference that focused 
on learning and technical aspects of computers and education, and Bushncll 
(Ref. 16 and Ref. iM. describes present and future roles of digital computers 
in American education. Goodlad (Rcf. MO, discusses present and potential 
applications of computers in education, and Margolin (Ref. 70), gives an inter- 
disciplinary vu-w of computers in the classroom. 

Some conjectures about computers in education in the future are made 
by Crowe 11 (Ref. 2*), end by Zinn (Rcf. 120), and Caffrcy (Ref. 17), in a 
non-technical report, makes a general survey of the possibilities of their 

use in higher education. 

Computer-assisted instruction at the U.S. Naval Academy is described 

by Concord (Rcf. 22), and by Sandeford (Ref. 90). 

A survey of the present state of educational technology over the world 

is given in a special issue of the magazine, Educational Technology , November, 

1969 (Rcf. 31). It includes articles on seventeen countries. 

Computer-assisted instruction came into existence at a time when 

traditional education practices were being severely critized and consequently 

may have been seized upon over-eagerly as the answer to many of education's 
Ills, according to Gentile (Ref. 39). While earlier writers were enthusiastic 
in their praise of, and their expectations for, CAI , some ..ore recent writers 
take a less exalted view of computers in education. 

Grayson (Rcf. M>) , in writing about problems in computer-assisted 
instruction, suggests that ignorance about the learning p.occss, rather than 
technical capabilities, nay be the limiting factor in computer- ass isted instruction, 
and Rogers (Ref. 08), also discussing problems of computers in education, lists 
gaps that ar^ left in the instructional process, limitations imposed by systems, 
and difficulties in the production of materials as areas requiring attention. 
Darnowski (Ref. 27), includes technological problems, such as break-downs and 
lack of flexibility, as well as educational prolans in his survey of efforts 
and potential of CAI. Oettinger (Ref. 76), says that some of the earlier 
• claims of educational technology now seem unfounded, while Abramson (Rcf. 1), 

.sees its greatest potential in very large-scale implementation. 
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r HleC^f 39) in hts critique of computer-assisted instruction, 
Gent. 1c (Ref. 39J , fMch |„ q - learning variables, in 

ensues the necessity f o r rcscarc ^ ^ ^ 

1ndW 1dua, differences, end ,n * arn n ^ 
suggests that computers can be used effect ve y 

s0 ,v,ng tools and in ^^^^Z' ^ ^ *' 
inefficient in tutorial and dr,ll-and p a-t.ee 

tint CA.'s acceptance by the educational community must be 

that Ml P Qf teaching . 

cut advantages that-t o .or. over ^ 

Coapulor-nanaged instruct, on ' * t „ chcr 

listed instruction in ,,h,ch the computer is used to * ~£ 

- tte ,n ( r; r « * — 

(Ref. 115), and Silberraan (Uef. 92), ano a fk 
(Ref. 49). 

• — "ion and description of ^-^^r:;^ 

- - - r^r^es th t e ' t in - JL. - -ra- 

the possibility and « ^ now functlo nin g succcss- 

tion of learning systems. There are many Other fields, 

fu „y ,. various fields, and ^scr Pt.ons f . " - ^ ^ ^ 

as well as additional writings about the ones .nc.u 

the literature search progresses. describes a system approach 

* «" °< 5Cien "' ' P.- H Le specific appHca- 

to science education, and Lunette (Ref. 65), d " er '" of sIcul ,atcd 

,on,. Umbo (Ref. 60) cobras the £ ^ f- M«. 

— ory experiments as opposed to actu °^ the „ t)ovo1 

computer applications in phys.es, chom.stry, 

Academy. - n computers in the 

Tan (Ref. 104). discusses the potential of «1 » ^ 
emulation of genetic phenomena that, because c HI «« * < . ^ 
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•„ hiolonv teaching, and Grimes (Ref. 47), 
th0 use of time-sharc computers n V l89 , M , unkn(Mn5 . 

wrUcs of fl. use of a conput to * ^ ^ „ ^ 

G ,„ ana other, * ; .. . ^ ^ and slmulatlons , 

demonstration of ecolog.cal systc s. 

eeo^clca! relationships and processes e |b 

Tnc neld of mathematics "*^ | , dIscu5s the use of colters 
ond Zoet (r.ef. l ? .2),vad Trovers (Ref. 103). 

in mathematics education. _ computing unities 

Mathews (Ref. 72), ocsc ,b s *e-* mathomati 

arc used as a supplementary 1 toraton ^ ca)culus cou rse based 

courses at .owe State Unlvers, y. A P * ^ (Ref< 5)> and 

on CR1CISAM at the U.S. Uava< Acadcm c ^ UmUed 

UinbacU (Ref. «). — ho, a sma Ue 9 ^ ^ _ , f 

facilities and a small .athenat.es department 

computer-assisted instruction. ^ be ^ , y • tro- 

Hontague (Uef. 75), shows ^ Qf North ^ the 

duced with computer programing, a computer - SU pple- 

0 ,dlnary differential cation course a bee ^ prob)em )$ 
nentcd one, according to Kemper (Ref. 5 

by oamasl-os (Ref. 26). (Ref . W) , describe 

,„ the field of statist.es, _ st , t lstlcs and compare three 

the machine used in an experimental course ,n ^ ^ ^ 

TOd es of instruction (computer, lecturer, and pr 

time spent in the course and the grade . recede (Ref . 7) , 

Computers in the phys.es cur cult* .r ^ c0 , putcr -based physics 

a „d both B,um (Ref. 6), end Sh.rer (Ref . J >. ^ Un)versUy> 

course. A multi-media genera W - " J ° ^ of audiotaped , cct ures, 

gained by i'.romhaut and other (Re ^ qgl2ZCS> 
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Chemical education has rude widespread application of computers, and 
among the program descriptions vould be Grandcy (Ref. *»5) , who describes the 
use of the PLATO system, using a TV screen and keyset for each student to 
determine chemical formulas and equations at the University of Illinois. 
Lagowski (itaf. 59), discusses the various types of computer-assisted instruction 
possible in chemistry education including simulated experiments, drill and 
practice, and tutorial activities, and he includes a list of programs in 
chemistry developed at the University of Texas* A Perdue University program 
providing for the use of the computer in data acquisition and data processing 
is designed as a laboratory course that accompanies the traditional type 
course, and it is discussed by Perone and Eagles ton (Kef. 80) • Stevenson 
(Ref. 97), points out the advantage of using programmed computations for 
problems in such areas as ionic equilibrium, quantum mechanics, and statis- 
tical mechanics, because doing such computations n by hand 11 would require 
so much time that classroom demonstrations would be prohibitive. 

Basic chemical formula writing taught by computer is described 
by Boblick (Ref. 9). Smith (Ref. 96), explains the use of the PLATO system 
In undergraduate courses in organic chemistry at the University of Illinois, 
and Rodewald (Psf. 87), discusses another organic chemistry course that uses 
colored filnstrip frames, under direct computer control, as an integral part 
of the course. 

Perone (Ref. 8o) , gives a detailed description of computer application 
in teaching gas chromatography by describing the programming and instrumentation 
necessary and by listing lab assignments and required materials and equipment. 

Lower (Ref. 62), explains the use of audiotapes prepared by the 
lecturer as a means of clarifying problem areas in an introductory chemistry 
course. 

Teaching numerical methods in chemistry by teaching computer programming 
and by surveying topics in numerical analysis are viewed by Johnson (Ref. 53), 
as ways of updating the education of graduate and undergraduate students in 
chemistry. 

Young (Ref. 119), lists three criteria to be used in determining 
whether or not computers should be used in chemical education. 
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